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ny consideration of the Rorschach 

as a research instrument should in- 
clude a joint consideration of the con- 
ceived use of the instrument and the 
user’s conception of the measurements 
obtained from the instrument. The 
theory of Rorschach scoring categories 
and the function of the test in the re- 
search program are each integral parts 
of this consideration. Thus, it becomes 
important at the outset to specify 
whether the Rorschach is to be used in 
describing or making predictions about 
individuals or about groups. The present 


* The data on which this report is based were 
collected by members of the professional staff 
of the Neuropsychiatry Branch, Professional Di- 
vision, Bureau of Medicine and Surgery, De- 
partment of the Navy, with the cooperation of 
the Basic School, Marine Corps School, Quantico, 
Virginia, and the Navy Graduate School in 
Washington, D.C. The following personnel col- 
lected the data: Lt. Comdr. H. B. Molish, MSC, 
USNR; Lt. Comdr. J. W. Bagby, Jr., MSC, 
USN; Lt. Comdr. R. 5. Herrmann, MSC, USN; 
Lt. J. J. Conger, MSC, USNR; Lt. (jg) H. B. 
Murphree, MSC, USN; Lt. (jg) D. L. Briggs, 
MSC, USNR; Hospitalman Chief L. H. Watson, 
USN; Elizabeth Broomhead, clinical psychologist 
in charge, Neuropsychiatry Service, U. §. Naval 
Hospital, Bethesda, Maryland; Margaret Elliott, 
clinical psychologist, U. $. Naval Hospital, Ports- 
mouth, Virginia; and Paul Sayers, clinical psy- 
chologist, U. S. Naval Hospital, Bethesda, Mary- 
land. The writers are extremely grateful to these 
people for the large amount of work which they 


report purports to use the Rorschach in 
the description of individuals and groups 
of individuals. The statistical approach, 
often disparaged for Rorschach interpre- 
tation, is for the present task altogether 
appropriate, 

It is not the purpose of the present 
report to imply that a particular group 
exhibits a unique “personality.” The 
methodology of the Rorschach most use- 
ful in the recognition of an individual's 
personality structure, as revealed by the 
test, is dependent upon the interrela- 
tions of the Rorschach indicators with- 
in a given protocol. However, this does 


did to make this report possible. We also wish 
to acknowledge the most helpful assistance of 
Capt. G. N. Raines, MC, USN, formerly head, 
and Capt. E. V. Caveny, present head of the 
Neuropsychiatry Branch, Bureau of Medicine 
and Surgery, Department of the Navy, for the 
encouragement received during the various stages 
of the study and for their handling of the ad- 
ministrative problems attendant to the coordina- 
tion of the research projects discussed in the 
body of this monograph. 

* This study is one of a series prepared for the 
Neuropsychiatry Branch, Professional Division, 
Bureau of Medicine and Surgery, Department of 
the Navy, under ONR Contract N7 onr 434 
with Tulane University. The opinions expressed 
herein are those of the authors and do not neces- 
sarily reflect the opinions of the sponsoring 
agency, the Department of the Navy, or the 
opinions of the cooperating agency, the U. §. 
Marine Corps. 
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Fic. 1. Floor layout for Group Rorschach. 


not mean that normative data such as 
here presented are unrelated to the inter- 
pretation of an individual Rorschach 
protocol. On the contrary, it is strongly 
urged that such normative information 
provides, either implicitly or explicitly, 
the very framework necesary in , the 
evaluation of the individual protocol. 
Furthermore, this framework is particu- 
larly useful and important when one is 
concerned with the Rorschach record of 
an individual from a special subpopula- 
tion, or with a record obtained using 
some modification in the administration 
or scoring procedures, 

In the present report, the test ad- 
ministration and scoring procedures are 
first described, Following this is a de- 
scription of the subpopulations together 
with their Rorschach norms. The im- 
portant problem of reliability is then 
considered and conclusions regarding 
administration procedures are presented. 

Testing procedures. Projected images 
of standard Rorschach plates were pre- 
sented on a 5 ft. & 7 ft. beaded screen 
to groups of subjects (Ss) assembled in a 
room in a seating arrangement provided 


to minimize the distortion of two factors: 
perspective foreshortening and the visual 
angle subtended by the projected image. 
The angle subtended when viewed on 
the screen was approximately the same 
as that subtended in an individual Ror- 
schach test when the plate is held ap- 
proximately 22 in. from the eye of the 
viewer. 

The physical arrangements for testing 
shown in Fig. 1 provided for seating a 
maximum of 30 men. 

When the Ss were seated, the following 
instructions were read to them: 


In a few minutes the room will be darkened 
and you will be shown ten inkblots on the 
screen, one at a time. You will write down the 
things suggested to you by the inkblots. There 
will be enough light to do this and you don't 
need to worry about either spelling or hand- 
writing. The responses will be written in the 
booklet which you have. You will start writing 
on page three in the second column. Place a 
Roman numeral I for card 1, in the center of 
that page on the top line. At the completion of 
the showing of each card, skip down a few 
spaces and write down the number of the next 
card, If you fill page three, turn to page five, 
then to page seven, and so on, using only one 
side of each page. If you fill the booklet, raise 
your hand and another one will be passed out to 
you, 

This test is called the Rorschach test, Everyone 
goes about responding to it in his own way, so 
there are very few rules we can give you. Each 
inkblot will be thrown on the screen for three 
minutes. You are to write down what you can 
make out on the card, what it looks like to you, 
or what resemblances you may find in it. There 
are no right or wrong answers, because no two 
people see the same things in the blot, nor are 
they necessarily reminded of the same objects. 
For each new idea you get from each blot, start 
writing what you see on a new line, numbering 
your lines on the left-hand side of the column. 

After we begin, no questions will be answered 
from the floor, but if you have any difficulty, 
please raise your hand and one of us will come 
to your chair. Absolute quiet is necessary 
throughout the test. Are there any questions? 


Routine were answered; 
then the room was darkened and each 
plate was projected on a glass beaded 
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screen under constant, controlled condi- 
tions for 3 min. in the upright position. 
An opaque projector, #D-10862 made 
by C. Deseler Company, was used. 

Each S wrote his responses (R's) to 
each plate in a special booklet provided 
for this purpose. This was done during 
the time the card was being projected, 
with additional time allowed after each 
projection for completing the R's to the 
card. 

Controlled illumination in the room 
was maintained just high enough for 
comfortable recording of the R's by the 
S. Soft pencils were used to make it 
easier for the Ss to see what they had 
written in the dimly lit room. The il- 
lumination incident upon the screen, 
with projector on, was 1 ¢.p, as measured 
on a standard General Electric Selenium 
Photometer, model DW 48, with hood 
open. 

After the ten plates had been pre- 
sented, Ss were asked if any of them had 
previously taken the test, and any in- 
stances of prior exposure to the ink- 
blots were noted on the cover of the re- 
sponse booklet for the use of the psy- 
chologist during the inquiry period, 
Alter completion of the R's to the test 
plates, the booklets were collected. An 
individual inquiry was then conducted 
with each man by a skilled Rorschach 
administrator in the manner characteris- 
tic of the inquiry interview used under 
conditions of individual administration 
of the Rorschach test. The test was 
scored by the psychologist who con- 
ducted the interview. 

The eight clinical psychologists who 
scored the protocols had an experience 
range of from 6 to 14 years as clinicians 
(median, g.5 years); they had an experi- 
ence range of from 3 to 12 years in Ror- 
schach administration (median, 7 years). 


Four expressed preference for scoring 
according to Klopfer, four preferred 
Beck. All used an agreed-upon scoring 
method, 

The subpopulations and their norms. 
One thousand men from four different 
assessment programs comprised the 
Marine subpopulation. Three hundred 
and seventy-four Navy officers tested in 
three different assessment periods while 
attending a Navy graduate school com- 
prised the Navy subpopulation. The bil- 
lets for which the men in these two 
groups all had volunteered were dis- 
tinctly different. Furthermore, biographi- 
cal information obtained from Ss in the 
two groups reveals group differences. 
The median candidate in the Marine 
group was 221% years of age, had spent 
most of his life in a city with a popula- 
tion between 25,000 and 100,000, had a 
Protestant religious background, and had 
completed two years of college. All of the 
Marine Ss had at least six months prior 
military service, and 75, per cent had over 
28 months prior service. All of the Mar- 
ine Ss were candidates for officer com- 
missions, and 70 per cent were noncom- 
missioned ofhcers, The median candidate 
in the Navy group was 24 years of age, 
had spent most of his life in a city with 
a population of over 100,000, had a 
Protestant religious background, and had 
completed four years of college. The 
Navy group showed a bimodal distribu- 
tion for previous military service; one 
mode was at three months, one at 99 
months or over. The range of rank held 
in the Navy group was from ensign to 
commander, with the median falling at 
lieutenant (jg). Tables 1 and 2 present 
the Marine and Navy frequency norms 
for the major scoring categories used and 
the percentile scorings corresponding to 
those norms. 
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TABLE 1 


Grour-ADMINISTERED RORSCHACH Norms ror ScoRING CaTeEGorIES HAVING 
RELIABILITY COEFFICIENTS OF .85 OR HIGHER 


(Marine N = 1000; Navy N = 374) 


| Rorschach Scoring Category 


Percentile R W 4 W% Fe 
Ma- Ma- | Ma- | Ma- Ma- 
rine Navy | rine Navy | rine Navy | rine Navy | rine Navy 
| 
2 10 I 3 ° ° 6 ° 
10 15 15 4 6 ° ° 13 8 | +o ° 
15 16 17 4 7 ° ° 16 a ° 
20 18 19 5 7 ° ° 18 27 ° ° 
25 | 19 21 5 8 ° ° 21 30 ° ° 
30 a1 22 6 9 ° ° 23 33 ° ° 
40 23 25 7 10 ° ° 29 4! I fe) 
50 25 28 8 in I ° 35 46 I I 
60 27 32 10 13 I I 42 52 i 1 
7° 30 35 11 16 I 1 47 57 2 I 
75 32 38 12 17 2 2 5° 60 2 2 
34 4t 13 18 3 2 56 63 2 2 
55 37 45 14 20 4 2 61 te 2 
ge 42 $2 15 33 | Ss 4 | 66 7o | «63 3 
95 5° 58 18 | 4 3 
59 64 21 2 10 86 go | 6 5 
Keliability -93 -94 
coefficient r r Cc 
Score-rescore | 
reliability | .97 | .38 
Rorschach Scoring Category 
Percentile M FM A AG 
Marine Navy |Marine Navy | Marine Navy Marine Navy 
2 ° ° ° ° I 3 16 10 
10 1 I 1 I 3 4 25 26 
15 I 2 I I 4 5 28 29 
20 2 2 I I 4 6 30 3I 
25 2 2 1 2 5 6 32 32 
30 2 3 2 2 6 7 33 34 
40 3 3 2 3 6 8 37 37 
5° 3 4 3 3 7 9 40 40 
60 4 4 3 4 | 8 10 42 42 
7° 4 5 4 5 9 1 45 46 
75 5 6 4 3 10 12 48 48 
80 5 6 5 6 | 10 13 50 50 
85 6 7 5 a 1 14 52 52 
go 6 8 6 7 12 15 55 57 
95 8 9 6 9 | 14 17 61 61 
98 10 it 8 a 17 19 | 67 67 
Reliability 86 85 .go 99 
coefficient ¢ r r 
Score-rescore 
reliability 64 | -80 | 88 


(Continued on next page) 
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TABLE 1 (Continued) 
(Marine N= 1000; Navy N = 374) 


Rorschach Scoring Category 


Percentile Ad 


RELIABILITY AND NORMS OF THE GROUP-ADMINISTERED RORSCHACH 


A obj. 


| Hd At 


_ Marine Navy 


Marine Navy Marine Navy 


Marine Navy 


= OCC 0O000 


| 


OCC O000 
OOOO 


Reliability 
coefficient 


Score-rescore 
reliability 


ts 


A comparison of the distribution for 
the two groups reveals a different ‘‘nor- 
mal” pattern of test score distribution. 
While the N of the Navy subpopulation 
is smaller than that of the Marine group, 
it is still sufficiently large to justify the 
assumption of stability of the norm data. 
The differences between the distribu- 
tions for the two groups cannot be attri- 
buted to chance fluctuation. This result 
indicates that interpretations of the “nor- 
mal superior adult Rorschach pattern” 
must be made within the context of the 
norms for the subpopulation to which 
S belongs if the full significance of the 
Rorschach scoring categories is to be ob- 
tained from the interpretation of the 
protocol. 

A comparison of the distribution for 
the various categories obtained through 
the group administration with those ob- 
tained from the traditional individual 
administration of the Rorschach cards 


ine 


| 


suggests that the results obtained by the 
group procedure do not differ greatly 
from those usually reported for similar 
populations under conditions of individ- 
ual administration. Beck et al. (3) re- 
port for their Spiegel sample a mean of 
total R’s of 32.65 with an SD of 17.68. 
The mean total R's for our Marine sam- 
ple was 27.52 and for our Navy sample 
it was 31.26. When one considers that 
there was some positive skewness in the 
distribution of our R scores, it is sug- 
gested that the total number of R’s ob- 
tained is essentially the same for the two 
types of administrations, The chief varia- 
tion observed between our norms and 
Beck's norms was in the location R's. In 
both our samples there were a greater 
number and percentage of W R's, The 
greater frequency of the W responses 
were made, of course, at the expense of 
the other determinant responses, i.e., D, 
Dd, and dd R’s. A second category in 


| 5 
10 
15 
20 
25 
30 
40 
50 
60 
70 
ho 
85 
95 
98 
| 87 
| | .97 | 
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TABLE 2 


Grovup-ApMINISTERED RorscHach Norms ror ScorinG CaTecories HAVING 
RELIABILITY COEFFICIENTS OF LESS THAN .85 
(Marine N = 1000; Navy N = 374) 


Rorschach Scoring Category 
Percentile D dd D% dd% S% 
Marine Navy Marine Navy (Marine Navy | Marine Navy | Marine Navy 
2 ° ° ° ° 
15 6 ° 35 29 ° ° ° ° 
20 7 7 33 ° ° 
30 9 9 39 ° ° ° ° 
40 o | 53 43 ° en ° 
5° 13 13 ° 58 48 ° | ° 
60 15 1s ° | 62 53. 2 ° 
70 17 18 I ° 67 57 3 "a 3 2 
75 8 20 I °o | 7 60 4 5 | 3 3 
20 ae ea a) 63 5 7 4 3 
85 22 24 2 I 75 67 7 a 5 5 
go 25 a8 3 2 77 73 9 . Bee 6 
95 29 33 4 4 82 76 13 18 10 9 
98 37 38 8 7 87 83 20 28 16 12 
Reliability 83 “45 81 | .82 
coefficient r ; r 
Score-rescore | 
reliability | .83 49 17 
Rorschach Scoring Category 
Percentile F% F+% k, K KF FK 
| Marine Navy | Marine Navy* Marine Navy | Marine Navy | Marine Navy 
2 12 14 67 50 ° ° ° ° ° ° 
10 23 26 65 ° % ° 
15 26 30 85 69 ° il ° ° ° 
20 29 33 87 74 «Cl ° ° ° ° ° ° 
25 32 35 89 7 | © 
30 44 37 go 8o | ° ° ° 
4° 39 40 93 86 ° ° 
50 43 44 95 go ° ® ° 
60 47 48 99 93 | ° 1 
70 52 52 100 100 I ° ° ° I I 
75 55 54 100 100 ° 1 I 
58 57 100 roo | 2 
85 61 61 100 100 | Py 2 
go 65 66 100 100 2 2 | ° ° 2 3 
95 7° 7° 100 100 3 2 } 1 ! 3 4 
98 77 77 100 100 5 4 
Reliability .78 .O7 34 
coefficient r Cc m4 Cc 
Score-rescore 
reliability | .82 | 26 $4 68 | 


* F+% score after Beck, for Navy group. 


(Continued on next page) 
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TABLE 2 (Continued) 
(Marine N =1000; Navy N = 374) 


Rorschach Scoring Category 
Percentile Fm, m c+c' Cc CF FC 
Marine Navy | Marine Navy | Marine Navy | Marine Navy | Marine Navy 
2 ° ° ° ° ° ° ° ° | ° ° 
10 ° ° ° ° ° ° ° ° 
15 ° ° ° ° ° ° ° a ° 
20 ° ° ° ° ° ° ° 
25 ° ° ° ° ° ° ° I ° ° 
3° ° ° ° ° ° ° | 
40 ° ° ° ° ° I 1 
5° ° ° ° ° ° ° I 2 I 1 
60 I ° I ° ° ° I 2 1 2 
70 I I I 1 ° ° 2 3 2 2 
75 I I I I ° ° 2 4 2 2 
80 I 1 2 I I { 3 4 2 3 
85 2 1 2 I I I 3 5 2 3 
go 2 2 2 2 I 1 3 . 7 = 4 
95 2 2 3 2 2 ie a a 5 
98 3 3 5 3 3 a 9). cf 6 
Reliability .10 .70 .40 
coefficient Cc Cc Cc 
Score-rescore 
reliability .02 | .65 04 
Rorschach Scoring Category 
A+H 
Percentile Cont: No. | Cont: No. | P% O+% %R's 
Ad+Hd Normal R Clin, R | VIII-X 
Ma- Ma- | Ma- | Ma- | Ma- Ma- 
rine Navy) rine Navy*| rine Navy*, rine Navy} rine Navy} rine Navy 
2 ° 1.0 ° ° 3 2 ° ° 16 18 
10 1.2 1.5 1 | 9 23 26 
15 1.4 2.0 I | ° 10 10 ° ° 25 28 
20 2 12 ° 26 29 
25 1.9 2.6 2 13 30 
30 2.2 2 14 13 ° ° 29 31 
40 2.8 4.0 3 | 16 ° 30 33 
50 4 I 18 32 34 
60 5.0 7.0 4 hae | 20 20 5 3 33 36 
7° 6.5 8.0 5 1 22 ag 8 4 35 38 
75 7-3 9.0 5 2 | 24 26 | 10 4 36 39 
80 9.0 10.0 6 2 26 28 II 5 38 40 
85 10.§ 12.0 7 | 2 28 ph! Bg 4 40 42 
go 12.0 15.0 9 43 
95 15.0 18.0] 11 4 | 35 38 20 23 44 48 
98 17-0 20.0| 14 | 5 4 50 26 42 50 53 
Reliability | 71 | .63 | 53 | 72 | 63 | 56 
coefficient r Cc Cc r 
Score-rescore | 
reliability | | .63 | 


* Data not available on Navy sample for Cont: No. Norm. R or, Cont: No, Clin. 
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| 


ROHRER, HOFFMAN, BAGBY, HERRMANN AND WILKINS 


TABLE 2 (Continued) 


(Marine N = 1000; Navy N = 374) 


Rorschach Scoring Category 


(H) 


H 


of 


CC 


20480 
d 


Reliability 
coefficient 

Score-rescore 
reliability 


~> OUND 


which a deviation was obtained was that 
of the F%,. In the Marine group adminis- 
tration, the mean of the distribution of 
r%'s was 45-05. In the Spiegel sample, 
the mean of the F%’s was 70. One other 
point should be noted concerning the 
scoring categories presented, The F + %, 
calculated for the Marine group was 
strange to most of the clinicians and, 
as shown in the results on reliability, 
much confusion resulted from this scor- 
ing of F+% with a resulting lowering 
of reliability. The norms obtained for 
this scoring, then, are not very meaning- 
ful. 

If one assumes that the R pattern ob- 
tained by exposure to the Rorschach 
cards involves a constant, systematic 
source of error variance in the use of 
the group- and individual-type adminis- 
trations, then one can generalize the find- 
ings concerning the necessity of develop- 
ing norms for distinctive subpopulations 


83 


to all types of Rorschach testing; 1.e., the 
necessity for developing norms for sub- 
populations in individual Rorschach test- 
ing is just as great as the demonstrated 
necessity of such norms for use with the 
group presentation of the inkblot cards. 

One other hypothesis is suggested in 
the normative data presented in Tables 
1 and 2g. The mean number of R’s for 
the 1,000 Marine officer candidates was 
7.52. This is higher than those reported 
by Guilford for his Air Force population. 
Guilford (8) reported a mean of 20 R's 
under individual administration. The 
total number of R's in our study is com- 
parable to Lord's (16) result with college 
students under conditions of “positive 
individual administration.” The median 
number is also higher than that reported 
by Sells (20) for the SAM Group Ink- 
Blot Test which he developed and stand- 
ardized on U. S. Air Force cadets and ofh- 
cers. In view of Lord’s and the Air 


8 
Percentile zc = 
"Marine Navy | Marine Navy | Marine Navy Marine Navy Marine Navy 
2 | 
10 
15 | 
20 
25 
30 
40 
50 
60 
7° | 
75 
Bo 
85 
90 
9 | 
| 
r r 
| | 
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Force's results showing that the protocols 
obtained under conditions of individual 
administration are influenced signifi- 
cantly by the administrators, plus the 
results reported herein that show that at 
least an average or above average num- 
ber of R’s is obtained with the use of 
the described group method, the fol- 
lowing hypothesis is suggested: For re- 
search purposes, our group technique 
results in a more reliable and possibly a 
more valid protocol than can be ob- 
tained under conditions of individual 
administration. This hypothesis that a 
more valid protocol results under group 
administration is suggested by the fact 
that the protocols thus obtained are less 
influenced or disturbed by interaction 
between administrators and examinee." 

Reliability of the group method, \n- 
vestigations of the reliability of Ror- 
schach testing technique may convenient- 
ly be classified under one of three head- 
ings depending on whether the study is 
concerned with the reproducibility of: 
(a) S’s responses to the cards; (b) the scor- 
ing made of the response protocol; (c) the 
interpretations made from the scored 
protocols. Unfortunately, the interpreta- 
tions to be made of some studies are 
olten equivocal because of the fact that 
several variables have been concomi- 
tantly operating. Systematic considera- 
tion of the number of independent varia- 
bles which could be manipulated in Ror- 
schach-type inkblot reliability studies re- 
veals that there are at least 13 such vari- 
ables. These variables, and citation to 
reports where they have been studied, 
are as follows: 


1. Physical character of sets of cards pre- 
sented (g, 21) 


2. Individual and group administration (8) 


* A report is in preparation of a study designed 
to test this hypothesis. The results of that study 
offer positive support to the hypothesis. 


. Changed environmental conditions for 
card presentation (8, 13, 16, 2g) 
. Sequence of card presentation (17) 
. Homogeneity-heterogeneity of status posi- 
tions of Ss (1, 5) 
6. Set of Ss for test task (6, 19) 
7. Constancy-variability in Ss’ psychodynamic 
structure (12, 16, 21, 29) 
. Administrator differences (7, 8, 16) 
9. Method for assigning scoring symbol to R 
(2, g, 11, 14) 

10, Scorer skill in assigning symbol to R (18) 

11. Interpretation of scores (2, 14) 

12, Presence or absence of R inquiry (5, 7) 

13. Frequency of card presentation (16) 

This monograph reports on Rorschach 
scoring reliability as influenced by: (a) 
different individual inquiries concerning 
the R's made in the same basic protocol 
obtained under conditions of group ad- 
ministration; and (b) the reliability of 
rescorings of the same protocol without 
benefit of inquiry information. All of 
the other 11 possible variables were non- 
operative in this study, being controlled 
by randomization, confounding, or by 
holding them constant. 

The reliability procedure. One thou- 
sand Marine ofhcer candidates were 
tested in four different assessment pe- 
riods using the group procedure outlined 
above. During one assessment period, 
430 men were given the test as described. 
Of this group, 100 were selected at ran- 
dom and called back two days later and 
given a second inquiry concerning the 
R's they had made in the original pro- 
tocol, These men were assigned at ran- 
dom to the clinical psychologists with the 
restriction that no candidate saw the 
same psychologist twice. The written 
protocols, without the first inquiry re- 
sults available, were given the different 
psychologists the second time and each 
scored them individually after conduct- 
ing a second inquiry, The data from 
these 100 rescorings were used for the 
“effect of different individual inquiries” 
portion of the reliability study. One year 
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later 56 of the written protocols were 
rescored by some of the same psycholo- 
gists who did the original scoring. I hese 
latter rescorings were done without the 
use of any inquiry information. These 
data constituted the “score-rescore” por- 
tion of the reliability study. 

The reliability results. Tables 1 and 2 
present the results of the “‘scoring-with- 
inquiry” reliability study (in the tables 
these are labeled reliability coefficient), 
and the score-rescore reliability study. 
These results are presented in terms of 
reliability coefficients for the various 
categories. Two different measures of re- 
lationship were employed. When the as- 
sumptions of normal distribution and 
linearity of regression were satisfied, prod. 


uct-moment correlations were calcu- 


lated. Where either of these assumptions 
was not tenable, means square contin- 
gency correlations were calculated. For 
the scoring-with-inquiry results, 13 of the 
categories had reliability coefficients of 


85, or better, Thirteen other categories 
had correlations between .63 and .85, the 
remaining one-third had correlations 
ranging from .o7 to .56. The reliability 
for the scoring-with-inquiry study stood 
up fairly well for the major scoring cate- 
gories that are important for individual 
test interpretation. Seven of those cate- 
gories had coefficients of .go or better; 
five of them fell within the range of from 
.8o to 8g; three fell within the range of 
from .70 to .79. Only two of them were 
low~the coefhcients for FC and CF, in- 
dicating some confusion on consistent 
scoring of these categories, i.e., difficulty 
in determining whether color or form 
was the determining factor. It should 
also be noted that four of the reliability 
coethcients do not differ significantly 
from zero. Those were F+%, c+c', k, K 
and dd%. Thus, the norms for those 
scoring categories are not meaningful 


and should be disregarded for purposes 
of interpretation. 

Tables 1 and 2 also present the reli- 
ability coefhcients obtained by correlat- 
ing the original scorings of the test and 
the rescoring done one year later. When 
the score-rescore coefficients were com- 
pared with the rescoring-plus-inquiry co- 
efficients it was found that 24 of the score- 
rescore coefficients were lowered, 13 of 
them were raised, and 2 remained the 
same. It should be noted explicitly that 
while the norms for the group admini- 
stration of the Rorschach plates are 
possibly different from the norms ob- 
tained under conditions of individual 
administration, these differences do not 
influence the interpretations made of the 
reliability portions of this study. That 
is, the conditions and techniques used 
for the score-rescore and the individual- 
inquiry-plus-rescoring procedure are 
identical with those used under condi- 
tions of administration. 
Therefore, the results of the reliability 
portions of this study can be generalized 
to individual scoring procedures in ad- 
dition to the group scoring procedures. 

A question may be raised concerning 
systematic skill differences which might 
exist among the who con- 
ducted the inquiries and scored the pro- 
tocols. To examine the extent of those 
differences, a correlational analysis was 
made for one Rorschach category, C. 

A total of 2: different pairs of psy- 
chologists may be formed from the seven 
psychologists who participated in the 
inquiry study. Owing to the random- 
ization procedure, only 14 different com- 
binations of psychologists met the re- 
quirement that each member of the pair 
had seen at least four candidates, with 
the further restriction that half of the 
individuals be seen first by one member 
of the pair of psychologists and the re- 


individual 


clinicians 
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TABLE 3 


Source of Variation 


Deviations from average regression within groups 


Deviations from individual group regressions 


Differences among group regressions 


maining half first by the other member 
of the pair. When these requirements 
were applied, 56 cases were isolated trom 
the original 100. The scoring-with-in- 
quiry correlation for those 56 cases orig- 
inally was .73, which was increased to 
.77 when the variations attributable to 
the differences among pairs of psycholo- 
gists was eliminated by computing 
squared deviations from the individual 
regression for each of the different com- 
binations, and pooling the sums ol 
squares after establishing that the regres- 
sions could reasonably be assumed to 
come from a homogeneous population. 
Table 3 presents the results of these 
calculations and demonstrates that the 
obtained mean square for differences 
among regressions is what would be 
expected by sampling from a homogene- 
ous population. Therefore, the average 
regression is the best available estimate 
of the population regression and the 
average of the correlation coefficients, 
computed from the sum of squares and 
products associated with this average 
regression, is free from the variations at- 
tributable to the differences in the com- 
binations of psychologists, 

The hypothesis is advanced that the 
inquiry-plus-scoring reliability —coefh- 
cients for all scoring categories would be 
raised by the same order of proportion as 
observed with the =C score—an increase 
of one-sixth of the remaining area for 
improvement—if the variance attribut- 


ANALYsIs OF Errors OF ESTIMATE FROM AVERAGE REGRESSIONS WITHIN GROUPS 


Errors of Estimate 


Mean Square F 


182.50 
167.66 


able to differences among particular 
pairs of scorers were eliminated. 


SUMMARY AND CONCLUSIONS 


A modification of the Rorschach test 
for use in group administration was de- 
scribed, This procedure permits the use 
of free association responses. 

Percentile various Ror- 
schach scoring categories were presented 
for two subpopulations to whom the 
Rorschach administered by the 
administration technique: (a) 
1,000 Marine $s, all candidates for ofhcer 
were noncommis- 
sioned ofhcers); and (b) 374 Navy ofhcers 
who were attending a Navy graduate 
school. The differences between the score 


norms for 


was 
group 


commissions 


distributions of the two groups cannot 
be attributed to chance fluctuation, and 
indicate that interpretations of the nor- 
mal superior adult Rorschach pattern 
must be made within the context of the 
norms for the subpopulation to which 
the S belongs if the full significance of 
the Rorschach scoring categories is to be 
obtained from the interpretation of the 
protocol. It follows that specific norms 
should be developed for different sub- 
populations of the normal superior adult 
male population. 

A comparison of the score distribu- 
tions for the various categories obtained 
through the group administration with 
those obtained from the traditional in- 
dividual administration of the Ror- 


11 
df 
28 | 
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schach cards suggests that the results ob- 
tained by the group procedure do not 
differ greatly from those usually reported 
for similar populations under conditions 
of individual administration. 
Scoring reliability was evaluated by 
two approaches. One measure of relia- 
bility was based on two independent 
scorings of the same basic protocol after 
the scorers had conducted independent 
individual inquiries; the other was based 
on two independent scorings of the origi- 
nal responses made to the cards without 
benefit of information obtained through 
the inquiry. The comparison of the re- 
liability of the scoring plus inquiry with 
mere rescoring indicated that the inquiry 
information resulted in correlations that 


were significantly higher than those ob- 
tained with the score-rescore data. The 
major scoring categories showed a rea- 
sonably satislactory set of reliability co- 
efhcients. 

Data were presented to indicate that 
variance in scorer skill lowers the ob- 
served correlations. 

An evaluation of the over-all scoring 
results obtained in this study with the 
results obtained by Guilford (8) and Lord 
(16) led to the development of a hypothe- 
sis that the group administration method 
as described herein, when used for re- 
search purposes, is superior to the indi- 
vidual administration method insofar as 
basic reliability and validity is concerned. 
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